Sep 11
20
A WebmasterWorld thread reports that Yahoo may not be fully listening to the robots.txt directive to block their spider, Yahoo Slurp. The thing is..
See original here:
Yahoo’s Crawler Not Listening To Robots.txt Directive?
Sep 11
20
A WebmasterWorld thread reports that Yahoo may not be fully listening to the robots.txt directive to block their spider, Yahoo Slurp. The thing is..
See original here:
Yahoo’s Crawler Not Listening To Robots.txt Directive?
This entry was posted on 2011/09/20 at 1:43 am. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.
Posted in SEO by admin No Comments Yet
Comments are closed.